Inference Fusion with Associative Semantics for Unseen Object Detection

نویسندگان

چکیده

We study the problem of object detection when training and test objects are disjoint, i.e. no examples target classes available. Existing unseen approaches usually combine generic frameworks with a single-path classifier, by aligning regions semantic class embeddings. In this paper, inspired from human cognitive experience, we propose simple but effective dual-path model that further explores associative semantics to supplement basic visual-semantic knowledge transfer. use novel target-centric multiple-association strategy establish concept associations, ensure predictor generalized domain can be learned during training. way, through reasonable inference fusion mechanism, those two parallel reasoning paths strengthen correlation between seen objects, thus improving performance. Experiments show our inductive method significantly boost performance 7.42% over models, even 5.25% transductive models on MSCOCO dataset.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Single-Shot Object Detection with Enriched Semantics

We propose a novel single shot object detection network named Detection with Enriched Semantics (DES). Our motivation is to enrich the semantics of object detection features within a typical deep detector, by a semantic segmentation branch and a global activation module. The segmentation branch is supervised by weak segmentation ground-truth, i.e., no extra annotation is required. In conjunctio...

متن کامل

Semantic middleware: multi-layer abstract semantics inference for object categorization

In this paper, we present a hierarchical model, named as Multi-layer Abstract Semantics Inference (MASI), based on Bag-of-Visual-Words (BoVW) to solve the problem of universal image categorization, including typical and zero-shot image categorization. An abstract hierarchical semantics learning method is proposed in the training step by extracting and selecting abstract visual words in a bottom...

متن کامل

Learning Search Based Inference for Object Detection

We study the problem of visual object detection and propose a method that learns the inference procedure during training time. We propose a best-first search based inference system that is already optimized for during training. This overcomes the inherent limitation of branch&bound whose applicability relies on the availability of tight bounding functions. The optimization problem is implemente...

متن کامل

Graph-based Inference with Constraints for Object Detection and Segmentation

For many fundamental problems of computer vision, adopting a graph-based framwork can be straight-forward and very effective. In this thesis, I propose several graph-based inference methods tailored for different computer vision applications. It starts from studying contour-based object detection methods. Compared to other image cues, the outline contour (silhouette) is invariant to lighting co...

متن کامل

Cooperative Coevolution Fusion for Moving Object Detection

In this paper we introduce a novel sensor fusion algorithm based on the cooperative coevolutionary paradigm. We develop a multisensor robust moving object detection system that can operate under a variety of illumination and environmental conditions. Our experiments indicate that this evolutionary paradigm is well suited as a sensor fusion model and can be extended to different sensing modalities.

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2021

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v35i3.16295